Search for: All records

We develop a framework to learn bio-inspired foraging policies using human data. We conduct an experiment where humans are virtually immersed in an open field foraging environment and are trained to collect the highest amount of rewards. A Markov Decision Process (MDP) framework is introduced to model the human decision dynamics. Then, Imitation Learning (IL) based on maximum likelihood estimation is used to train Neural Networks (NN) that map human decisions to observed states. The results show that passive imitation substantially underperforms humans. We further refine the human-inspired policies via Reinforcement Learning (RL) using the on-policy Proximal Policy Optimization (PPO) algorithm which shows better stability than other algorithms and can steadily improve the policies pre-trained with IL. We show that the combination of IL and RL match human performance and that the artificial agents trained with our approach can quickly adapt to reward distribution shift. We finally show that good performance and robustness to reward distribution shift strongly depend on combining allocentric information with an egocentric representation of the environment.

While the brain’s functional network architecture is largely conserved between resting and task states, small but significant changes in functional connectivity support complex cognition. In this study, we used a modified Raven’s Progressive Matrices Task to examine symbolic and perceptual reasoning in human participants undergoing fMRI scanning. Previously, studies have focused predominantly on discrete symbolic versions of matrix reasoning, even though the first few trials of the Raven’s Advanced Progressive Matrices task consist of continuous perceptual stimuli. Our analysis examined the activation patterns and functional reconfiguration of brain networks associated with resting state and both symbolic and perceptual reasoning. We found that frontoparietal networks, including the cognitive control and dorsal attention networks, were significantly activated during abstract reasoning. We determined that these same task-active regions exhibited flexibly-reconfigured functional connectivity when transitioning from resting state to the abstract reasoning task. Conversely, we showed that a stable network core of regions in default and somatomotor networks was maintained across both resting and task states. We propose that these regionally-specific changes in the functional connectivity of frontoparietal networks puts the brain in a “task-ready” state, facilitating efficient task-based activation.

Behavioral data shows that humans and animals have the capacity to learn rules of associations applied to specific examples, and generalize these rules to a broad variety of contexts. This article focuses on neural circuit mechanisms to perform a context‐dependent association task that requires linking sensory stimuli to behavioral responses and generalizing to multiple other symmetrical contexts. The model uses neural gating units that regulate the pattern of physiological connectivity within the circuit. These neural gating units can be used in a learning framework that performs low‐rank matrix factorization analogous to recommender systems, allowing generalization with high accuracy to a wide range of additional symmetrical contexts. The neural gating units are trained with a biologically inspired framework involving traces of Hebbian modification that are updated based on the correct behavioral output of the network. This modeling demonstrates potential neural mechanisms for learning context‐dependent association rules and for the change in selectivity of neurophysiological responses in the hippocampus. The proposed computational model is evaluated using simulations of the learning process and the application of the model to new stimuli. Further, human subject behavioral experiments were performed and the results validate the key observation of a low‐rank synaptic matrix structure linking stimuli to responses.